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A systematic approach to the analysis and construction of channel 
codes for digital baseband transmission is presented. The structure of the 
codes is dominated by the set of requirements imposed by channel charac- 
teristics and system operation. These requirements may be translated into 
symbol sequence properties which, in turn, specify a set of permissible 
sequence states. Stale-dependent coding of both fixed and variable length 
is a direct result. Properties of such codes are discussed and two examples 
are presented. 

I. INTRODUCTION 

1.1 General 

Binary information to be transmitted over a baseband digital system 
must typically be encoded into a sequence of symbols suitable for 
transmission through the channel. The structure of such codes is 
dominated by the set of requirements imposed by considerations 
such as channel characteristics and system operation. Several codes 
designed for baseband transmission have been discussed in the litera- 
ture, 1 - 2 - 3 but the analysis of such coding has received little attention. 
This paper presents a systematic approach to the description and 
construction of codes for such application. The symbol sequence to 
be generated by the code is viewed as the output of a sequential ma- 
chine with a set of permissible states derived from the imposed re- 
quirements. State-dependent codes, both of fixed and of variable 
length, are a direct result. Various properties of such codes are dis- 
cussed, and two examples are presented. 

An advantage of using a sequence-state point of view is the ease 
with which it may be adapted to computer analyses, which are feasi- 
ble due to the typically short word length of such codes (usually less 
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than eight symbols), and useful because normal design procedure 
often entails the construction of a number of codes, derived from 
different sequence requirements, in order to compare properties. 

1.2 System Requirements 

A block diagram of a baseband digital transmission system is shown 
in Fig. 1. Binary signals are encoded into a sequence of pulses (sym- 
bols) which are transmitted over a channel with regularly spaced re- 
constructive repeaters. 4 Typically, a number of factors strongly 
influence the choice of a channel code. Examples are: 

(i) The symbol sequence is often required to furnish timing infor- 
mation to the repeaters. 

(u) The channel may impose restrictions on the spectral shape of 
the sequence. Most such systems, for example, have a transmission 
null at dc. This implies that long strings of symbols of one polarity 
cannot be tolerated. 

{Hi) Provisions for monitoring the channel error rate during normal 
operation may be necessary. 

(iv) Pulse sequence requirements must be satisfied independently 
of the source statistics. 

Requirements such as the above may usually be translated into 
limitations on the length of strings of like symbols, specifications of 
sets of allowable transitions between symbols (such as when a + 2 
pulse must be followed by a — 2 pulse to avoid timing jitter due to 
asymmetries), and bounds on the variation of the running digital 
sum. The latter is defined as 



t(T) = Z 



a, 



where {a t } are the weights assigned to the channel symbols and T 
is an arbitrary but fixed time. 

The objective of the code designer is to specify a code which meets 
the imposed conditions while obtaining maximum information ca- 
pacity (average number of bits per channel symbol) or alternatively 
to optimize sequence properties. 
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Fig. 1 — Block diagram of a baseband digital transmission system. 
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1.3 Permissible Sequences 

A code may be defined as a mapping from the binary input infor- 
mation to the ensemble of symbol sequences which satisfy the im- 
posed criteria. The allowable symbol sequences can, in turn, be speci- 
fied by a set of permissible states {s,} for each point, describing such 
quantities as the present value of the running digital sum, the pre- 
ceding number of symbols of a given type, etc. In addition to the {s t }, 
it is convenient to define a set of allowable words {wj}, which take the 
sequence through a succession of allowable states, one for each sym- 
bol in the word. A necessary condition for Wj to be permissible is that 
there exists at least one state s r such that the states resulting from the 
use of Wj at s r are all allowable. In addition, the words to be used in 
the code may be restricted to a subset of {w,} which satisfies require- 
ments not specified by a particular choice of states, such as various 
error-correcting properties. The latter restriction will not be treated 
in this paper. 

It is assumed in this paper that each code word carries an integral 
number of information bits, and that the ratio of bits per symbol re- 
mains constant over each word. The latter assumption is a sufficient 
condition for synchronous transmission. 

II. FIXED LENGTH CODE STRUCTURE 

2.1 General 

The simplest codes of the above type are those of fixed length, 
which may be defined as mappings from the set of input binary words 
of length log 2 L to the set of allowable words {Wj} of length N. These 
mappings are generally state-dependent. That is, the choice of a code 
word may be a function of the state occupied by the sequence. 

It is convenient to introduce a number of definitions. 

Definition: W(Si) is the set of words (alphabet) of length N which 
take the symbol sequence from state s t through a succession of allow- 
able states. 

The fact that each word Wj must carry « = log 2 L information bits 
implies that words used in a code must terminate in states for which 
W(s) contains a minimum of 2" words. 

Definition: The principal states {S m } of the channel sequence are 
those states for which W{S,„} contains at least 2 a words each of which 
takes the sequence to another principal state. 
The existence of a set of principal states is a necessary and suf- 
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ficient condition for the existence of a code. It is possible to implement 
computer search routines for finding such states. The appendix con- 
tains a description of a search method which was used as an aid on 
constructing the two codes in Section 5.2. 

A given code actually occupies a subset {<r n } of the principal states 
at the end of code words. Let W*M C W(<r n ) be the words actually 
used for coding when the sequence occupies the state o n . 
Definition: <r„ and <r k are in the same alphabet class R g if and only if 

The above relation partitions the set of terminal states into alphabet 
classes R g , q = 1,2, . . . Q. A set of words W*(R g ) is associated with 
each such class. Each W* {R q ) contain 2" words which are used when 
the sequence occupies one of the terminal states in the class R q (i.e., 
each word in W* (R Q ) , q = 1, 2, . . . Q is associated with one binary 
input word b c ) . It is advantageous to minimize the number of alphabet 
classes in order to simplify the coding and decoding circuits. 

The coder tracks the state of the symbol sequence, and at the end 
of each word, codes the next binary word b g into a word chosen from 
the alphabet corresponding to the state occupied by the output se- 
quence. For example, the Paired Selected Ternary 1 code book con- 
sists of two alphabets, which contain words of zero or positive weight 
and zero or negative weight, respectively. The coder switches to a 
different alphabet after use of a word with non-zero weight. 

2.2 State-Independent Decoding 

The class of codes defined in Section 2.1 may be uniquely decoded 
provided the state of the symbol sequence is known. Frequently, how- 
ever, it is not feasible for the decoder to distinguish which member 
of a given subset of states the sequence occupies at the end of a code 
word. For example, the states may be functions of the instantaneous 
symbol sequence sum. Here a single error in detection may result in 
an unbounded string of decoding errors. In addition, implementation 
of state-dependent decoding requires circuits to track the sequence 
state. Thus, state-independent decoding may often be necessary. 

Decoding independently of the state is possible if and only if one 
binary word b. corresponds to each code word w t c {it),}. That is, the 
state-dependent mapping of [b,] into {Wj} must have a unique in- 
verse. If decoding is to be independent of the state within a given 
subset of the terminal states, the above mapping must have a unique 
inverse within this subset. 
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Given a group of terminal states {<r q }, q = 1, 2, ... Q, and their 
associated alphabets W* (<r g ) [each containing 2" words] , it is desirable 
to determine whether it is possible to code so that decoding is in- 
dependent of q. The following are necessary and sufficient conditions 
for the above : 

Condition 1: A sufficient, but not necessary, condition for the existence 
oj an assignment of binary words to the members of W*(<r,) q = 1, 2, • • ■ Q 
so that decoding is independent of t is that for any integers u, v such that 
1 ^ u < v ^ Q 

w, t W*M fl W*(a.) -* w r t W*(v u+l ). 

Proof: Suppose that a binary word b. has been assigned to w T in the 
alphabet W*(<r u ). Then it is possible to give w r the same binary assign- 
ment in W*(a u+1 ) • • • W*(a,). The lack of necessity of the above condi- 
tion may be demonstrated by a renumbering of the alphabets. 

Condition 2: A necessary and sufficient condition for the possibility of 
assigning binary words to the members of W*(a e ), 6 = 1,2 • • ■ so 
that decoding is independent of 6 is that for 1 ^u ^.v ^x S-® and for each 

w r c W*(a u ) fl W*(v x ) 
such that 

w r 4 W*(<r,) 

there exists a w v z W*(<r,) such that there exists no a m , 1 ^ m ^ 0, for 
which w T , w v e W*{a m ). 

Proof: Sufficiency follows from condition 1 by requiring that w p and w T 
be equivalent (in the sense that they are assigned the same binary word) . 
The necessity of the condition follows from the fact that if 

w r i W*(a T ) 

then some other word w v t W*{a,) must be assigned the binary word 
assigned to w r in the wth alphabet. But if w p ,w r t W*(a m ), 1 ^ m ^ T, 
state-independent decoding is precluded. 

It is obvious from the above conditions that state-independent 
decoding is always possible when there are only two alphabets (as in 
Paired Selected Ternary 1 ). An example of a group of alphabets which 
do not admit state-independent decoding is shown in Table I. 

2.3 Framing 

The received symbol sequence must be correctly partitioned into 
blocks of words length N before decoding. This may be done by ob- 
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serving whether the received words coincide with the words utilized 
in a code, by tracking the sequence state to determine whether ends 
of the received words coincide with sequence terminal states, or by 
looking for the presence of nonallowable sequences of permissible 
words. 

III. VARIABLE LENGTH CODES 

3.1 General 

Attempts to increase fixed length state-dependent code efficiency 
with constraints on pulse sequence properties result in increased 
word length, and thus in rapidly mounting coder and decoder com- 
plexity, reframe times and sensitivity to detection errors. Hence, 
variable length codes, which may combine the advantages of short 
and long word lengths, are frequently advantageous. 

Consider a sequence of symbols generated by a fixed length code 
of word length N. The sequence by definition occupies a principal 
state at the end of each word. Often, however, a principal state will 
be entered in the middle of a word. This offers the possibility of using 
the word fragment to convey information, and of starting any of at 
least 2 a words from this point (by definition of a principal state). The 
result, subject to a number of restrictions outlined below, is a variable 
length code. 

Variable length codes offer the possibility of using short words more 
frequently than those of longer lengths. This often permits a marked 
decrease in coder and decoder complexity relative to a fixed length 
code of like efficiency and sequence properties, since the number of 
stored words may be far smaller. For example, VL43 (described be- 
low), a three alphabet variable length code, uses a total of 56 words, 



Table I — A Set of Alphabets which do not Admit State- 
Independent Decoding. 
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compared to the 256 required for a single alphabet of a fixed length 
code of equal efficiency and sequence properties. 

3.2 Variable Length Code Structure 

The structure of variable length codes required to satisfy sets of 
sequence requirements is quite similar to that of fixed length codes. 
A number of special features, however, arise from the presence of 
words of different lengths. 

The requirement of synchronous transmission, coupled with the 
asumption that each word carries an integer number of information 
bits, implies that the word lengths in a given code are integer multiples 
of a basic word length N, where N is the smallest integer for which 
the bit per symbol ratio a/N is that of two integers (i.e., if the bit per 
symbol ratio is 1.5, the basic word length is 2). The proof of this state- 
ment follows from the fact that the word length KiN must be such 
that the number of bits per word Kpt is an integer [this paper covers 
the transmission of binary data]. Suppose that K t = n + b, where n 
is an integer and < b < 1. Then b« and bN must also be integers, 
which violates the definition of A r . 

The set of allowable words may be written as {?%}, t = 1, 2, . . . , 
M , where w^ is the ;th word of length iN. 

Definition: Wt(si) is the set of words of length iN, i = 1, 2, . . . , M , 
which may be used in the permissible state Sj without violating the 
sequence requirements. 

W( Sl ) = 0^*(«i). 

A set of principal states may be defined for a symbol sequence as- 
sociated with a variable length code in a manner analogous to that 
of Section II. 

Definition: The principal states {Si} are those allowable states for 
which W(Si) contains sufficient words terminating in principal states 
to maintain an information rate of a bits per N symbols. 

The number of words of length iN, i = 1,2 ... M required to main- 
tain a bit rate of a bits per N symbols is given by 

LiPFfo)] + L 2 [W( Sl )]2- a + ■ ■ • + L M [W(8 t )]2- lM ' 1)a = 2", 

where L,-[W(sj)] ls ^ ne number of words in TF",(s t ). Equation (1) clearly 
indicates the advantage of using as many short words as possible. 
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The terminal states {tr m { are as defined in Section II. Similarly, 
W*(a m ) and W*(<r m ) are those members of W t (<r m ) and W(* m ), respec- 
tively, which are actually used in the code; two terminal states cr m 
and <r„ are in the same alphabet class if and only if PP*(0 = W*M. 

It is clear that 

for all w it , w kr e W*{<r.) and w„ * w kT . P,(w tr ) denotes the first iN 
symbols of the word w kT . The above condition follows from the fact 
that Wn t W(S a ) implies that w i{ , when used in the state S. , takes 
the sequence to another principal state. 

3.3 State-Independent Decoding 

State-independent decoding of a variable-length code is desirable 
for the same reasons as for one of fixed length. The criterion for such 
decoding is the same as for a fixed length code — the state-dependent 
mapping from the binary words {b e } to the words to be transmitted in 
the channel must have a unique inverse. Two considerations which 
affect the complexity of this mapping are the presence of words of 
length iN,i = 1,2, ..., M and the existence of words which consist 
of concatenations of two or more shorter words. Such word combina- 
tions will be called concatenated words. It follows from Section 3.2 
that a concatenated word and its prefix cannot occupy the same 
alphabet. From Section 3.2, it can be concluded that a concatenated 
word of length iN is a legitimate word in a given alphabet if no 
terminal state is reached with the KNtb. symbol for < K < i. A 
requirement for state-independent decoding is that the binary words 
assigned to a concatenated word be concatenations of the binary 
words assigned to the words of which the concatenated word is com- 
posed. Section 5.2 contains an example of a variable-length code 
which satisfies these criteria. 

3.4 Framing 

The process of framing (at the decoder) a symbol sequence gen- 
erated by a variable-length code may be divided into two parts: 
partitioning the sequence into blocks of length N (the basic word 
length), and properly grouping these blocks into words of length iN, 
i = 1, 2, . . . , M. Framing may be performed in much the same man- 
ner as for a fixed-length code. A misframe condition may be detected 
by noting the presence of nonpermissible words, word sequences which 
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do not occur in the code, and/or the occupation of a nonterminal state 
at the end of a word. 

It is often possible to substantially simplify the framing process by 
ensuring that secondary misframing (the condition that results from 
improper grouping of blocks of length N into words) is self-terminat- 
ing. This restricts the need for framing to blocks of length N (the 
basic word length), and frequently results in superior framing per- 
formance compared to a fixed length code of equal efficiency and 
sequence properties. 

Consider a state-independent decoder which stores all word prefixes 
of length iN,i = 1,2, . . . , M-l, and which operates in the following 
manner: If the first fN symbols that are received form a prefix of a 
legitimate word, the decoder considers the first (/+1) N symbols. 
Otherwise the first fN symbols are decoded into an arbitrary binary 
word of length fa. The concatenated words are treated as strings of the 
shorter words of which they are composed. 

A sufficient condition for secondary misframing to be self-termi- 
nating in the above decoder is that (excluding concatenated words) 

E T [W ki ] 9* P r [W mt ] 

for all r, k, i, m, e such that e > r and i > r. E r [w ki ] denotes the last 
rN symbols of the word w ki . This ensures that the secondary mis- 
framing condition terminates with the ending of the word w ki . 

IV. PERFORMANCE MONITORING 

It is often necessary to monitor the level of channel performance 
without interrupting service. Codes with bounded sequence sums 
readily lend themselves to this objective, especially in the low noise 
environment typical of telephone communications systems. This is 
because an error is quite likely to eventually cause the sequence sum 
to exceed the imposed bounds. Alternatively, the behavior of the 
digital sequence at the bound can be observed. For example, not more 
than one consecutive zero (null pulse) might be permitted at extreme 
sequence sum values, while strings of length N > 1 may occur at 
intermediate sums. Here, the detection of a string of zeros at an ex- 
treme sequence sum value indicates that an error has occurred in 
detection. An advantage of these methods 1 is that error monitoring 
can be performed without framing. 

Standard methods of error monitoring (or error detection) can also 
be incorporated in a code of this form. A possibility is the require- 
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merit that the words have even digital sums, or more generally that 
the terminal states {a s } be separated by a minimum "distance." 

V. CODE CONSTRUCTION 

The foregoing sections have described a number of features of 
state-dependent codes. Steps in the construction of a code in this 
class are outlined below. 

(i) Specification of the required channel symbol sequence prop- 
erties. 

(ii) Translation of the requirements into a set of acceptable states. 

(Hi) Search for the permissible words in each allowable state. 
Search for the principal states. The above can be done either by hand 
or by a computer search routine such as that described in the ap- 
pendix. 

(iv) Terminal states and code words are chosen for (if necessary) 
state-independent decoding, to optimize spectral properties, error 
monitoring and framing statistics. This usually requires much tedious 
computation. 

It may occur that a given set of sequence requirements are such 
that a set of principal states does not exist for codes of word length 
JV, but that a length of MN yields an acceptable code. In this case, a 
variable length code of basic word length N with maximums length 
MN might be a possibility. It is advantageous to use as many words 
of length N as possible, and to utilize the longer lengths to achieve a 
sufficient number of words inn each terminal state. 

VI. EXAMPLES 

The following two ternary codes, one of fixed length and one of 
variable length, are examples of results of the above procedures. 
These codes were designed for possible use in a future high-speed 
baseband digital communication system. 5 The symbols to be trans- 
mitted on the line consist of positive, negative and null pulses. The 
main objectives in the design of these codes was to restrict the varia- 
tions in the running digital sum of the pulse stream (with positive, 
negative, and null pulses assigned values of +1, —1, and respec- 
tively) to avoid dc buildup in the channel, and to have as many transi- 
tions between symbols as possible in order to provide energy for 
self-timing in the repeaters. 4 
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The information capacity of each code is four bits for every three 
symbols. The allowable states are described in terms of the running 
digital sum. Words were chosen from those permissible in each state 
so as to maximize the number of transitions between symbols. The 
search routine described in the appendix was used as an aid in code 
construction. 

6.1 A Fixed Length Selected Ternary Code 

The MS43 selected ternary code (Table II) is an example of a 
fixed length, three alphabet code of word length three. The digital 
sequence sum varies over six levels, which are arbitrarily labeled 
zero to five. These six levels are the allowable states. Terminal states 
occur only at values of one to four inclusive. There are three alphabet 
classes. Ri and R 3 correspond to terminal states with sequence sums 
of one and four respectively, while R 2 corresponds to a sum of either 
two or three. The choice of MS43 words is such that strings of zeros 
and symbols of like sign are limited to lengths of four and five re- 
spectively. 

Coding is performed as a function of the terminal state. For ex- 
ample, if 00110100 is to be coded when the value of the sequence sum 
is +1, the first four bits are coded as — 1- and the second as 0+ + . 
It can easily be seen from Table II that decoding is independent of 
the state. 

6.2 A Variable Length Selected Ternary Code 

The VL43 code [Table III] is an example of a three alphabet 
selected ternary code of variable length. The basic word length is 
three and the maximum length six. The bit per symbol ratio is 4/3, 
as in MS43. Secondary misframing is self-terminating and decoding is 
state-independent. The variable length feature permits a decrease 
in the variation of the running digital sum from six to five levels, and 
a significant increase in density of transitions. There are three 
terminal states {ax, <r 2 , <*a) each with its own alphabet. W*{tro) con- 
tains only words of length three. W*{<ti) and W*{<t 3 ) each contain 16 
words of length six (each carrying eight bits) and 15 words of length 
three. Both W*(a-i) and W* (0-3) contain concatenated words. 

Coding is performed in much the same manner as for MS43. For 
example, if 110000010000 is to be coded when the state is <r 2 , the first 

four bits are coded as h, after which the state is 01. The next eight 

bits are coded into a six symbol word, — 1 1 K 
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Table II— 


MS43 Code Book 




Binary Equivalent 


fti 


ft. 


ft. 


0000 


+ + + 


-+- 


-+- 




0001 


++o 


00- 


00- 




0010 


+0 + 


0-0 


0-0 




0100 


+ + 


-00 


-00 




1000 


+- + 


+- + 







0011 


0- + 


0- + 


0- + 




0101 


-o+ 


-0 + 


-0 + 




1001 


00 + 


00 + 







1010 


0+0 


0+0 


-0- 




1100 


+00 


+00 


0-- 




0110 


-+0 


-+o 


-+o 




1110 


+-o 


+-o 


+ -0 




1101 


+0- 


+0- 


+0- 




1011 


0+- 


0+- 


0+- 




0111 


-++ 


-++ 


-- + 




1111 


++- 


+-- 


+-- 





VII. CONCLUSION 

This paper has presented a description of a number of properties of 
multilevel coding for synchronous baseband transmission. The domi- 
nant feature of such coding is the set of pulse sequence requirements 
imposed by channel characteristics and system operation. It was 
shown that multialphabet and variable length codes are a natural 
consequence of attempting to attain high efficiency with codes of this 
type. 
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APPENDIX 

A Search Routine for the Principal States of a Ternary Sequence 

This appendix describes a search routine to find the principal states 
and associated code words from a given ensemble of ternary sequences. 
The codes are of fixed word length N and the symbol sequence is re- 
quired to have the following properties : 

(i) The maximum number of different levels which can be assumed 
by the running digital sum (with positive, zero and negative pulses 
assigned values of +1, 0, and —1, respectively) is 2Q + 1. 
(ii) The maximum number of consecutive zeros is R. 
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Table III — VL43 Code Book 





alent 


Alphabet for Coder State 


Binary Equiv 


F*(«) 


W*( ai ) 


W*(<r») 


0000 




+- + 


+- + 




0001 






-+- 


-+- 


0010 




0+0 


0+0 


-0- 


0100 




+00 


+ -- 


+-- 


1000 




00 + 


00 + 


--0 


0011 




0+- 


+ - 


0+- 


0101 




+0- 


+0- 


+0- 


1001 




+ +0 


00- 


00- 


1010 




+0 + 


0-0 


0-0 


1100 




+ + 


-- + 


-- + 


0110 




+ -o 


+ -o 


+ -0 


1110 




-+o 


-+o 


-+o 


1101 




-o+ 


-o+ 


-0 + 


1011 




0- + 


0- + 


0- + 


0111 




++- 


++- 


0-- 


1111 




-++ 


-++ 


-00 




W*(a) 




W*(oi) 


Binary Equivalent 


Alphabet 


Binary Equivalent 


Alphabet 


00010000 


-+-+-+ 


00000000 


+-+ 


00010001 


+++-+- 


00000001 


+-+-+- 


00010010 


-+-0+0 


00000010 


+ -+-0- 


00010100 


- + -+00 


00000100 


000 + -- 


00011000 


- + -00 + 


00001000 


+ - + --0 


00010011 


+ + + -0- 


00000011 


+0 + 


00010101 


+ + + --0 


00000101 


++0 


00011001 


- + -++0 


00001001 


+ -+00- 


00011010 


- + -+0 + 


00001010 


+ -+0-0 


00011100 


- + -0 + + 


00001100 


+-+--+ 


00010110 


000+ + - 


00000110 


000 + -0 


00011110 


000- +0 


00001110 


000 h 


00011101 


+++--+ 


00001101 


++- 


00011011 


+ + + -00 


00001011 


hOO 


00010111 


-+-++- 


00000111 


+ -+0-- 


00011111 


000- + + 


00001111 


+ - + -00 



(in) The maximum number of consecutive pulses of like sign is 
P ^ 2Q. 

The first step is a search for the set {w} of words of length N which 
satisfy the above conditions. 

Let it),- = a u a 2i • • • 2 Ni , with a,,- = —1, or +1. It is then required 
that 



-Q ^ Z an ^ +Q 
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for all r, p such that 

1 ^ r ^ N 

1 ^ P ^ r, 
where N is the fixed word length. Moreover, if 

a,-,,- = a, + i,,- = ••• = a 1 + P _i,/ = ±1 
then 

Also, if 

a,,,- = a 1+1 ,,- = dt+u-i.i = 

then 

a i+R ,i 5* 0. 

Next, a set of allowable states s(t,u,v) is defined, where t denotes 
the value of the running digital sum of the pulse sequence, u the 
preceding number of zeroes and v > {v < 0) the number of preced- 
ing positive (negative) pulses. It is required that 

-Q^t^Q, O^u^R, -P^v^P. 

The words {w}, when used in a particular state s(t,u,v) take the 
sequence through N states. A word Wj is permissible in s(t,u,v) if 
and only if the N resulting states are allowable. Each word in {w} 
is tested to determine the states in which it is permissible. The re- 
sult is that a set of words {w} t ,u,v is associated with each state s(t,u,v) . 
When the above procedure is completed, the program searches for 
the principal states. States which contain less than 2 a words are dis- 
carded. Then, for each remaining state s(t,u,v), those words in 
{w}t,u,v are eliminated which terminate in a state which has been 
discarded. If {w} t ,u,v contains fewer than 2 a words after this opera- 
tion, s(t,u,v) is eliminated. This procedure is continued until either 
no states remain or the routine runs through a complete cycle of 
states without eliminating any words or states. In the latter case, the 
remaining states are the principal states, {<r 5 }, and the remaining 
words are {W(<r q )}. 
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